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1.  Summary  of  Technical  Progress  Made  Under  this  Grant 
By  Each  Supported  Student 

1.1  Convergence  of  Backward  Error  Propagation  Learning  in  Photorefractive 
Crystals  (primary  student  on  this  effort:  Gregory  C.  Petrisor) 

We  have  analytically  determined  that  the  backward-error-propagation 
learning  algorithm  has  a  well  defined  region  of  convergence  (in  neural  learning- 
parameter  space)  for  two  classes  of  photorefractive-based  optical  neural  network 
architectures,  and  derive  a  set  of  sufficient  conditions  for  the  optical  neural 
network  to  converge.  The  analysis  includes  characteristics  of  photorefractive 
materials  such  as  grating  decay  under  illumination  and  linearity  of  response  as 
used  in  an  optical  architecture  versus  ideal  neural-network-model  weight 
updates.  The  theoretically  proven  results  are  also  verified  by  means  of 
simulation.  The  convergence  conditions  are  related  to  two  experimental 
parameters,  system  gain  and  photorefractive-crystal  exposure  energy  [1]. 

We  have  also  investigated  the  effects  of  limitations  of  spatial  light 
modulators  on  the  performance  of  the  same  classes  of  optical  neural-network 
architectures.  Phenomena  studied  include  non-ideal  modulator  contrast  ratio, 
limited  detector  d5mamic  range,  and  detection  noise  [2]. 

1.2  Gain  and  Exposure  Scheduling  to  Compensate  for  Photorefractive  Neural- 
Network  Weight  Decay  (primary  student  on  this  effort:  Adam  A. 
Goldstein) 

We  have  developed  a  gain  and  exposure  schedule  that  theoretically 
eliminates  the  effect  of  photorefractive  weight  decay  for  the  general  class  of 
outer-product  neural-network  learning  algorithms  {e.g.,  back  propagation, 
Widrow-Hoff,  perceptron).  This  schedule  compensates  for  photorefractive 
diffraction  efficiency  decay  by  iteratively  increasing  the  spatial-light-modulator 
transfer  function  gain  and  decreasing  the  weight-update  exposure  time. 
Simulation  results  for  the  scheduling  procedure,  as  applied  to  back-propagation 
learning  for  the  exclusive-or  problem,  show  improved  learning  performance 
compared  with  results  for  networks  trained  without  scheduling  [3]. 
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3.  Summary  of  Academic  Progress  Made  During  the  Period 
of  this  Grant  By  Each  Supported  Student 

3.1  Gregory  C.  Petrisor 

Mr.  Petrisor's  grades  have  been  well  above  the  grades  needed  for  receiving 
the  Ph.D.  degree.  He  has  completed  his  course  work  and  his  Ph.D.  research,  and 
passed  his  final  oral  thesis  defense  near  the  end  of  this  grant  period.  His  official 
Ph.D.  graduation  date  was  in  December  1996. 

3.2  Adam  A.  Goldstein 

Supported  in  part  by  this  grant  and  in  part  by  other  grants,  Mr.  Goldstein's 
grades  have  also  been  well  above  the  grades  needed  for  receiving  the  Ph.D. 
degree.  He  has  also  completed  his  course  work  and  his  Ph.D.  research,  and 
passed  his  final  oral  thesis  defense  in  January  1997,  a  few  months  after  the  end  of 
this  grant. 
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